Skip to content

ETL-781: add support for setting pipeline resources#65

Merged
PabloPardoGarcia merged 21 commits intomainfrom
add-support-for-pipeline-resources
Mar 11, 2026
Merged

ETL-781: add support for setting pipeline resources#65
PabloPardoGarcia merged 21 commits intomainfrom
add-support-for-pipeline-resources

Conversation

@PabloPardoGarcia
Copy link
Member

@PabloPardoGarcia PabloPardoGarcia commented Feb 27, 2026 •
edited
Loading

Add support for pipelines resources, available from v2.11.0

@github-actions
Copy link
Contributor

github-actions bot commented Feb 27, 2026

Coverage

Test Coverage Report
FileStmtsMissCoverMissing
etl
   __init__.py50100% 
   api_client.py64592%70–73, 123
   client.py39489%59–61, 141
   dlq.py41197%70
   errors.py270100% 
   pipeline.py146795%334–337, 350, 406–407
   tracking.py260100% 
   utils.py11110%1, 3, 6, 8–11, 17–18, 22, 28
etl/models
   __init__.py110100% 
   base.py10460%7–10
   config.py34876%37, 40–41, 43–45, 47–48
   data_types.py800100% 
   filter.py17288%16, 22
   join.py51296%44, 80
   metadata.py40100% 
   pipeline.py100298%158, 161
   resources.py390100% 
   schema.py260100% 
   sink.py61788%33, 39, 47, 49, 53, 55, 61
   source.py132794%47, 51, 68, 81, 124, 150, 166
   stateless_transformation.py46882%44, 48, 52, 57, 69, 71, 73, 80
TOTAL9706892% 

@github-actions
Copy link
Contributor

github-actions bot commented Feb 27, 2026

Coverage

Test Coverage Report
FileStmtsMissCoverMissing
glassflow/etl
   __init__.py50100% 
   api_client.py64592%70–73, 123
   client.py39489%59–61, 141
   dlq.py41197%70
   errors.py270100% 
   pipeline.py146795%334–337, 350, 406–407
   tracking.py260100% 
   utils.py11110%1, 3, 6, 8–11, 17–18, 22, 28
glassflow/etl/models
   __init__.py120100% 
   base.py10460%7–10
   config.py34876%37, 40–41, 43–45, 47–48
   data_types.py800100% 
   filter.py17288%16, 22
   join.py51296%44, 80
   metadata.py40100% 
   pipeline.py100298%158, 161
   resources.py1227340%12–17, 25–28, 37–42, 50–53, 64–73, 83–90, 100–106, 116–123, 133, 135–141, 153, 155–165
   schema.py260100% 
   sink.py61788%33, 39, 47, 49, 53, 55, 61
   source.py132794%47, 51, 68, 81, 124, 150, 166
   stateless_transformation.py46882%44, 48, 52, 57, 69, 71, 73, 80
TOTAL105414186% 

@PabloPardoGarcia PabloPardoGarcia marked this pull request as ready for review February 27, 2026 17:03
@github-actions
Copy link
Contributor

github-actions bot commented Feb 27, 2026

Coverage

Test Coverage Report
FileStmtsMissCoverMissing
etl
   __init__.py50100% 
   api_client.py64592%70–73, 123
   client.py39489%59–61, 141
   dlq.py41197%70
   errors.py270100% 
   pipeline.py146795%334–337, 350, 406–407
   tracking.py260100% 
   utils.py11110%1, 3, 6, 8–11, 17–18, 22, 28
etl/models
   __init__.py120100% 
   base.py10460%7–10
   config.py34876%37, 40–41, 43–45, 47–48
   data_types.py800100% 
   filter.py17288%16, 22
   join.py51296%44, 80
   metadata.py40100% 
   pipeline.py100298%158, 161
   resources.py1227340%12–17, 25–28, 37–42, 50–53, 64–73, 83–90, 100–106, 116–123, 133, 135–141, 153, 155–165
   schema.py260100% 
   sink.py61788%33, 39, 47, 49, 53, 55, 61
   source.py132794%47, 51, 68, 81, 124, 150, 166
   stateless_transformation.py46882%44, 48, 52, 57, 69, 71, 73, 80
TOTAL105414186% 

@github-actions
Copy link
Contributor

github-actions bot commented Mar 2, 2026

Coverage

Test Coverage Report
FileStmtsMissCoverMissing
glassflow/etl
   __init__.py50100% 
   api_client.py64592%70–73, 123
   client.py39489%59–61, 141
   dlq.py41197%70
   errors.py270100% 
   pipeline.py146795%334–337, 350, 406–407
   tracking.py260100% 
   utils.py11110%1, 3, 6, 8–11, 17–18, 22, 28
glassflow/etl/models
   __init__.py120100% 
   base.py10460%7–10
   config.py34876%37, 40–41, 43–45, 47–48
   data_types.py800100% 
   filter.py17288%16, 22
   join.py51296%44, 80
   metadata.py40100% 
   pipeline.py100298%158, 161
   resources.py1227340%12–17, 25–28, 37–42, 50–53, 64–73, 83–90, 100–106, 116–123, 133, 135–141, 153, 155–165
   schema.py260100% 
   sink.py61788%33, 39, 47, 49, 53, 55, 61
   source.py132794%47, 51, 68, 81, 127, 153, 169
   stateless_transformation.py46882%44, 48, 52, 57, 69, 71, 73, 80
TOTAL105414186% 

@github-actions
Copy link
Contributor

github-actions bot commented Mar 3, 2026

Coverage

Test Coverage Report
FileStmtsMissCoverMissing
glassflow/etl
   __init__.py50100% 
   api_client.py64592%70–73, 123
   client.py39489%59–61, 141
   dlq.py41197%70
   errors.py280100% 
   pipeline.py146795%334–337, 350, 406–407
   tracking.py260100% 
   utils.py11110%1, 3, 6, 8–11, 17–18, 22, 28
glassflow/etl/models
   __init__.py120100% 
   base.py10460%7–10
   config.py34876%37, 40–41, 43–45, 47–48
   data_types.py800100% 
   filter.py17288%16, 22
   join.py51296%44, 80
   metadata.py40100% 
   pipeline.py103397%158, 161, 172
   resources.py1203769%31, 72–78, 88–95, 125–132, 142, 144–150, 167, 169, 172–174
   schema.py260100% 
   sink.py61788%33, 39, 47, 49, 53, 55, 61
   source.py132794%47, 51, 68, 81, 127, 153, 169
   stateless_transformation.py46882%44, 48, 52, 57, 69, 71, 73, 80
TOTAL105610689% 

@github-actions
Copy link
Contributor

github-actions bot commented Mar 6, 2026

Coverage

Test Coverage Report
FileStmtsMissCoverMissing
etl
   __init__.py50100% 
   api_client.py64592%70–73, 123
   client.py39489%59–61, 141
   dlq.py41197%70
   errors.py280100% 
   pipeline.py146795%334–337, 350, 406–407
   tracking.py260100% 
   utils.py11110%1, 3, 6, 8–11, 17–18, 22, 28
etl/models
   __init__.py120100% 
   base.py10460%7–10
   config.py34876%37, 40–41, 43–45, 47–48
   data_types.py800100% 
   filter.py15193%16
   join.py49197%44
   metadata.py40100% 
   pipeline.py116793%160, 186, 189, 221–224
   resources.py1203769%31, 72–78, 88–95, 125–132, 142, 144–150, 167, 169, 172–174
   schema.py260100% 
   sink.py59689%33, 39, 47, 49, 53, 55
   source.py130695%47, 51, 68, 81, 127, 153
   stateless_transformation.py44784%44, 48, 52, 57, 69, 71, 73
TOTAL105910590% 

@github-actions
Copy link
Contributor

github-actions bot commented Mar 10, 2026

Coverage

Test Coverage Report
FileStmtsMissCoverMissing
etl
   __init__.py50100% 
   api_client.py64592%70–73, 123
   client.py39489%59–61, 141
   dlq.py41197%70
   errors.py280100% 
   pipeline.py146795%334–337, 350, 406–407
   tracking.py260100% 
   utils.py11110%1, 3, 6, 8–11, 17–18, 22, 28
etl/models
   __init__.py120100% 
   base.py10460%7–10
   config.py34876%37, 40–41, 43–45, 47–48
   data_types.py800100% 
   filter.py15193%16
   join.py49197%44
   metadata.py40100% 
   pipeline.py116793%160, 186, 189, 221–224
   resources.py1203769%31, 72–78, 88–95, 125–132, 142, 144–150, 167, 169, 172–174
   schema.py260100% 
   sink.py59689%33, 39, 47, 49, 53, 55
   source.py130695%47, 51, 68, 81, 127, 153
   stateless_transformation.py44784%44, 48, 52, 57, 69, 71, 73
TOTAL105910590% 

@PabloPardoGarcia PabloPardoGarcia merged commit de1521e into main Mar 11, 2026
6 checks passed
@PabloPardoGarcia PabloPardoGarcia deleted the add-support-for-pipeline-resources branch March 11, 2026 17:19
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@ashish-bagri ashish-bagri ashish-bagri approved these changes

@nnaumov-glassflow nnaumov-glassflow Awaiting requested review from nnaumov-glassflow

Assignees

No one assigned

Labels

bump:minor

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@PabloPardoGarcia @ashish-bagri @nnaumov-glassflow